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Abstract 

We discuss construction of coverings of the unit ball of a finite 
dimensional Banach space. The well known technique of comparing 
volumes gives upper and lower bounds on covering numbers. This 
technique does not provide a construction of good coverings. Here we 
apply incoherent dictionaries for construction of good coverings. We 
use the following strategy. First, we build a good covering by balls 
with a radius close to one. Second, we iterate this construction to 
obtain a good covering for any radius. We mostly concentrate on the 
first step of this strategy. 



1 Introduction 

Let X be a Banach space M*^ with a norm | 
corresponding closed unit ball: 

B ■= Bx := {x G R"^ : 

The open unit ball will be denoted hy B" :- 

B" := B"x := {x G M"^ 



and let 5 := Bv denote the 



< 1}. 



Bl: 



\x\\ < 1}. 



:i.2) 



Notation B{x,r) := Bx{x,r) and B°{x,r) := B'^{x,r) will be used respec- 
tively for closed and open balls with the center x and radius r. In case r = 1 
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we drop it from the notation: B°{x) := B°{x, 1). For a compact set A and a 
positive number e we define the covering number N^{A) as follows 

N,{A) := N,{A, X) := min{n : 3x\ . . . , : A C U]^^Bx{x\ e)}. 

The following proposition is well known. 

Proposition 1.1. For any d- dimensional Banach space X we have 

e-"<iV,(5x,X)<(l + 2/e)^. 

This proposition describes the behavior of N^{Bx, X) when e — )■ 0. In 
this paper we concentrate on the case when e is close to 1. In particular, 
we discuss the following problem: How many balls B°{x^) are needed for 
covering Bl In other words we are interested in the number 

N{d,X) ■= min{n : 3x\ . . . ,x" : 5x C U^=i5^(x^). (1.3) 

We prove here that if X is a uniformly smooth Banach space then N[d, X) = 
d + 1. With this result in hands we discuss the problem: How small e can 
be for the relation N^{B) = d + 1 to hold? The left inequality in Proposition 
11.11 gives the lower bound for such e: e > 1 — M£til Section 3 we prove 
an upper bound: e < 1 — Cd^"^. This upper bound follows from two different 
constructions given in Propositions 13.21 and 13.41 In both constructions we 
use a system V := {g^}'^t^l of vectors and built a covering of B2 in the form 
Uj^l 53(05'-', r) with an appropriate r. In Section 4 we apply this idea with V 
being an incoherent dictionary for covering in the Hilbert space £2- We prove 
the following bound in Corollary 14.11 For r = (1 — /i^)^/^, n G [(2n)"^/^, 1/2], 
we have 

Nr{B2) < 2exp(Cid/i2ln(2//i)). (1.4) 

In Section 5 we use incoherent dictionaries in a smooth Banach space X 
to build a good covering for Bx- Let p{u) denote the modulus of smoothness 
of X (see Section 3 below for definition) and a(/i) be a solution (actually, it 
is a unique solution) to the equation 

a/i = 4p(2a). 

We prove the following bound in Corollary 15.11 For r = 1 — |/ia(/i), < 1/2, 
we have 

NriBx) < 2 max(C2rf, exp(C2dp2 ln(2/p))). (1.5) 
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It is interesting to note (see Section 6) that in the case X := p G [2, oo), 
we have 1 — r = |/ia(/i) x /i^ as in the case X = 

In Section 6 we consider several specific examples of X and make a con- 
clusion that the technique based on extremal incoherent dictionaries works 
well and provides either optimal or close to optimal bounds in the sense of 
order of \nN,{Bx). 

2 Lower bounds 

We prove the following bound in this section. 

Theorem 2.1. Let X be a Banach space M°' with a norm \\ ■ \\. Then 

N{d,X) >d+l. 

Proof. We prove that any d balls B°{x^), j = 1, . . . , d do not cover B. Indeed, 
for a given set {B°{x^)}j^i consider the linear manifold M passing through 

M := {x : X = + - x^) + ■ ■ ■ + td~i{x'^ - x^), tj E M}. 

It is clear that M is a (d — l)-dimensional linear manifold. We use Lemma [2TT] 
below which guarantees that there is z E B, \\z\\ = 1 such that for any x E M 
we have \\z — x\\ > 1. Then z E B is not covered by the Uj^iB'^{x^). □ 

Lemma 2.1. Let X be a Banach space Mf^ with a norm || • ||. Then for any 
{d — 1)- dimensional manifold M we have 

d{Bx,M) := sup inf \\y - x\\ > 1. (2.1) 

Proof. Without loss of generality we can assume that M is a subspace. In- 
deed, by symmetry of Bx we have that d{Bx, M) = d{Bx, M~) where 

M" := {x : -X E M}. 

Let 

M = {x:x = x'^ + tiv} + ■■■ + td-iu'^'^, tj E M}. 
Define a subspace 

:= {x:x = t^u^ + ■■■ + td-iu'^'\ tj E M}. 
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Then d{Bx,M^) < d{Bx,M). Indeed, for any y e Bx there are a;+ G M 
and x~ G M~ such that 

< d{Bx,M), \\y-x'\\ < d{Bx,M-) = d{Bx,M). 

Set x° := {x+ + x-)/2 G M°. Then 

< \\y - x+\\/2 + \\y - x~\\/2 < d{Bx,M). 

So, we assume that M is a subspace. A standard proof of statements hke 
Lemma [271] is based on the antipodahty theorem of Borsuk (see, for instance, 
[2], p. 405). We give a proof that is based on ideas from functional analysis. 
Let w be a functional such that = 1 and w{x) = for x G M. 

Consider a norming functional for w. Our space X is a reflexive Banach 
space. So G Bx- For any x G M we have 

- x\\ > \w{F^ -x)\ = l. 

This completes the proof of Lemma 12.11 □ 

3 Upper bounds 

We begin with the case when the norm || ■ || = || ■ II2 is the Euclidean norm. 
Let {e^j^i denote the standard basis: el = if i ^ j and e^j = 1. 

Proposition 3.1. Define x^ := ^e^ , j = 1, . . . ,d and x'^^^ := — ^ X]j=i 
Then 

B, C U'^t\Bl{x^). 

Proof. We begin with describing a set that is not covered by B2{x^), k G 
[1, d]. Take any point y G B2. Then X]j=i — 1- Setting a := ^ we obtain 

h-x'^f = ^y] + {yk-af. 

If {yk — aY < yl then y G B°{x''). Thus those yk which are not covered 
by B°{x^) satisfy the inequality {yk — a)^ > yl which implies yk < a/2. 
Therefore, 

i?2 \ ^t=iB°2ix') CC:= {y : y G B^, yk < a/2}. 
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We now prove that C C S2(x^"^^). Indeed, for any y ^ C we have 

d d d 

k=l k=l k=l 

The inequality yk < a/2 implies yk < —\yk\ + o and 

d d 
k=l k=l 

Using 

d d 

^\yk\ >^yl 

k=l k=l 

we obtain 

d 

h<{l-2a)^yl + 3da^ < 1 - 2a + 3da^ < I - —■ 

k=l 

□ 

Proposition 3.2. Define a := 5^^, x-' := ae-', j = ano? x'^"'"^ := 

—a Xlj=i 6"' • T'/ien 

B2 C Uj"'i}5°(x^ r) OTi/i r > (1 - a2)i/2. 

Proof. The proof repeats the proof of Proposition I3.1[ We only point out 
the places where we make changes. First, we note that if j/^ > a then 
yl — {yk — > 0?. Therefore, in this case y G B2{x'',r). We have 

B2 \ ui^^Bl{x\ r)(lC' ■.= {y:ye B^, yk < a}. 

We now prove that C C B2{x'^^^,r). Similar to the above argument we get 

d 

b<{l-2a)^yl + 5da^ < 1 - 2a + 5da^ = l-a^ <r^. 

k=l 

□ 
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For a Banach space X we define the modulus of smootliness 
p{u) := ^sup + uy\\ + \\x - uy\\) - 1). 

Tlie uniformly smooth Banach space is the one with the property 

lim p{u)lu = 0. 

u—^O 

Proposition 3.3. Let X be a uniformly smooth Banach space M.'^ with norm 
II ■ ||. Define := ae^ , j = l,...,d and x'^'^^ := —0'Yl'j=i^''- Then there 
exists an a > such that 

B C U^^l|5°(x^). (3.1) 

Proof. Embedding (13.1 p is equivalent to the claim that for each y E B dX 
least one of the following d+1 inequalities is satisfied 

Ib-ae^ll <1, je[l,t/]; (3.2) 

d 

||y + a^e^||<l. (3.3) 

i=i 

In the proof that follows parameter a is small. We assume that a < 1/2. 
Then for y such that \\y\\ < 1/2 all inequalities (13.21) are satisfied. Therefore, 
in further argument it is sufficient to consider y such that 1/2 < \\y\\ < 1. 

For X 7^ let be a norming functional for x: ||-Fx||x* = 1 and 
Fx{x) = \\x\\. Existence of such a functional follows from the Hahn-Banach 
theorem. We note that from the definition of modulus of smoothness we get 
the following inequality (see, for instance, p. 336). 

Lemma 3.1. Let x ^ 0. Then 

< ||x + uy\\ - \\x\\ - uFx{y) < 2||a;||p(M||?/||/||x||) 

where F^ is a norming functional of x. 

This lemma implies the following inequalities 

||z/-ae^'||<||l/||-aF,(e^') + 2||l/||p(a/||l/||) 
< ||y||-aF,(e^H2||y||p(2a), jG[l,d]; (3.4) 
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d d 

lly + a^e^'ll < \\y\\+aFy(^e^) + 2p{2da). (3.5) 
i=i i=i 
Here, Fy is the norming functional of y. 

First, we note that for some k the [^^^(e'')! is large enough. Indeed, let 

y = Ei=i?/ie^ - Then 

\yj\ <Ci{d)\\y\\, j = l,...,d. 

We have 

d d 

\\y\\ = Fy{y) = Y,y3Fy{e^) < CMM E 

i=i i=i 
which implies that for some k E [1, rf] 

\Fy{e'')\>{dCMr' =--Ci. (3.6) 
Set h := Ci/2 and consider three cases: 

d 

Fy(J2en<-b, (3.7) 
i=i 

F,(J]e^)>6, (3.8) 

i=i 

d 

\Fy{J2en\<b. (3.9) 

j=i 

In the case (13.71) inequality (13.51) implies ( 13. 3 p if a := a{b,p,d) is sufficiently 
small (remind that uniform smoothness assumption implies p{u)/u — > as 
u — i- 0). In the case (13.81) we have for some k G [1, d] that Fy{e^) > b/d and 
this is sufficient to derive (13. 2p with j = k from (13.41) and small a. 

Consider the case (13.90 . Inequality (13. 6p guarantees that either Fy{e^) > 
ci or —Fy{e^) > ci. In case Fy{e^) > ci we complete the proof as in case 
(13.80 . In case —Fy{e^) > ci our assumption (13.90 implies that 



J2Fyie^)>-b 
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and 

d 

J2 Fy{e') >-b- Fy{e'') > -b + ci = ci/2. 
Therefore, for some m 

and we complete the proof as in case (13.81) . □ 

We now discuss another way of constructing a {d + l)-covering of the 
Euchdean balL It is based on the tight frames construction. We begin with 
a conditional statement. 

Proposition 3.4. Let $ := }jlt| be a system of normalized vectors, 
\\f-'\\2 = ^, j = ^, ■ ■ ■ ,d + 1, satisfying the condition 

{v\v') = -\, l<^^J<d+l. 
Then, there exists an a > such that 

Proof. In our proof a is a small number. Let a < 1/2. Then for any x, 
\\x\\2 < 1/2, and any G [1, + 1] we have 

— a(fk\\2 < 1- 

Thus, it is sufficient to consider x such that 1/2 < ||a;||2 < 1. For each k we 
have 

||x - aif'^Wl = \\x\\l + - 2a{x,ip^). (3.10) 

We now need to estimate (x, (f'^) from below. It is easy to check that our 
assumptions on $ imply the relations 

^ = ^E(x,¥^v, (3.11) 



d + 

d+ 

5^^* = 0, (3.12) 



■t=i 



i=l 

d+l 



(3.13) 



1=1 



We now need a simple technical lemma. 
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Lemma 3.2. Ify E is such that YliLi Hi = ^ then there exists k satisfying 

'\yh 



Vk 



> 



2{N-1)' 



Proof. The proof goes by contradiction. Suppose yj < 2(n-i) ^' 
note 

E+ := {j : y^ > 0}, := {j : y, < 0}. 

Then our assumption imphes (note that \E^\ < N — 1) 

jeE+ 

and, therefore, 

N 

\\y\\i = = 2 5^ < Wvh- 

3=1 j&E+ 

It is a contradiction. □ 

We apply Lemma [3.21 with N := d + 1, yj := (x, ip^). Then the condition 
JZiLiVi = follows from f l3.12p . Thus, by flS.lSp . taking into account that 
||3;||2 > 1/2, we derive from Lemma [3.21 that there exists k such that 



i=l 

By (IS.lOp we obtain for this k 

\\x-aip'\\l<l + a^--^. 

Specifying a = ^ we get 



□ 
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We now discuss a question of existence and construction of systems $ 
from Proposition 13.41 We only give one example of such construction which is 
based on the Hadamard matrices. Hadamard matrices are very useful in both 
theoretical research and engineering applications. In particular, Hadamard 
matrices are very popular in error- correct ion coding theory. A Hadamard 
matrix of order n is an n x n matrix if„ with all entries 1 or —1, and 



where In is the identity matrix. Obviously, any two columns or any two rows 
of a Hadamard matrix Hn are mutually orthogonal. This orthogonality is 
kept if we permute some rows or columns, or multiply some rows or columns 
by -1. Therefore, given any Hadamard matrix, we can always make a new 
Hadamard matrix which has all I's in the first row by multiplying some 
columns by -1. Hadamard matrices only exist for special orders n. The 
following lemma and remark are from [5]. 

Lemma 3.3. If Hn is a Hadamard matrix of order n, then n = 1, n = 2, 
or n = {mod 4). 

Remark 3.1. One of the famous conjectures in the area of combinatorial 
designs states that a Hadamard matrix of order n exists for every n = 
[mod 4). But we are still very far from a proof of this conjecture. The 
smallest n for which a Hadamard matrix could exist hut no example is known 
presently 428. 

There exists a variety of methods to construct Hadamard matrices. We 
can construct Hadamard matrices from so-called conference matrices (see 
[5]). We will not discuss this way. For illustration purposes we provide a 
very simple construction of Hadamard matrices of order 2^. The following 
lemma provides a recursive method to build Hadamard matrices of order 2^, 
where k = 0, 1, 2, .... 

Lemma 3.4. For k = 0,1,2, the matrices generated by 




n 



uL 



n 



H 



1 — 



H2 



1 1 
1 -1 



H2k — H2k 



are Hadamard matrices. 
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Proof. Clearly, Hi and H2 are Hadamard matrices of order 1 and 2 respec- 
tively. Assume is a Hadamard matrix of order 2^, then 



We need to show that 



H^k H2k 



H2k+iH2k+i 



2''L 



2k . 



Indeed, 



H2k H2k 
Hok — H2k 



2k 
2 

ttT 
ttT 



2k+l. 



T r 



-Hjk 



2if^if2fc 



H2k 

Hk 

H2k 
H2k 



'2H'^kH2k 



H2k 

H2k 
—H2k 



2'=+i/2. 



2^^+1/2. 



2^+H. 



2fe+l . 



□ 



We can build higher order Hadamard matrices from the Kronecker prod- 
uct of lower order Hadamard matrices. Let matrix A G i?"^"^ with entries a 



I] 



and B e El"^^. Then the Kronecker product A® B oi A and 5 is a n/ x mk 
matrix, 

aiiB ai2-B ■ ■ ■ dimB 

0-21-8 CI22-B ■ • • Cl2mB 



A®B 

The following simple lemma is known. 



.B 



Lemma 3.5. // Hm and Hn are Hadamard matrices of order m and n re- 
spectively, then H„i ® Hn is a Hadamard matrix of order mn. 

This lemma provides a good way to build higher order Hadamard matrices 
from known lower order ones. We can see that Lemma 13.41 is a corollary of 
Lemma 13. 5^ where the recursion is H2k+i — H2 (S) H2k. 
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The Hadamard matrices were used in pp for construction systems from 
Proposition 13.41 Such systems are called absolutely equiangular tight frames 
in[T]. 

Theorem 3.1. Let Hm be a Hadamard matrix with all I's in the first row 
and m = n + 1. Then, the columns of the matrix $ generated by deleting 
the first row of and dividing by y/n form an absolutely equiangular tight 
frame. 

Proof. All columns of Hm are mutually orthogonal. In other words, for any 
1 < 7^ j < the two columns hi and hj of Hm satisfy {hi, hj) = 0. 

Since the first elements of hi and hj are both 1, the corresponding columns 
(fi and (pj of $ satisfy 

iVuVj) = -{{hi,h,)-l) = -(0-1) = --, 
n n n 

for all 1 < i 7^ j < m. □ 



4 Covering using incoherent dictionaries 

Proposition 13.41 demonstrates how special dictionaries can be used for build- 
ing coverings. In this section we discuss an application of incoherent dic- 
tionaries in Euclidean space. Let V = {g''}^^i be a normalized = 1, 
k = 1, . . . , A^) system of vectors in equipped with the Euclidean norm. 
We define the coherence parameter of the dictionary V as follows 

M(P) ■.= snp\{g\g% 

k^l 

In this section we discuss the following characteristics 

N{d, /i) := sup{Ar : 3D such that #1) > A^, M{V) < /i}. 

The problem of studying N{d, /i) is equivalent to a fundamental problem 
of information theory. It is a problem on optimal spherical codes. A spherical 
code S{d,N,fj,) is a set of A^ points (code words) on the rf- dimensional unit 
sphere, such that the absolute values of inner products between any two 
distinct code words is not greater than /i. The problem is to find the largest 
A^* such that the spherical code S{d, N* , fi) exists. It is clear that A^* = 
N{d,fi). Denote by 'D{fi) a dictionary such that M(V{fi)) < ft and |2^(/i)| = 
N{d,fi). We call such 2^(/u) an extremal dictionary for a given fi. 
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Theorem 4.1. Let T>{fi) := {g^}i^li be an extremal dictionary for a given 
fi < (1/2)1/2. j^/^g^ 

B, C (Ufjf r)) U (Ufjf r)), = 1 - /x^. 
Thus, Nr{B2) < 2N{d,fx). 

Proof. Our assumption that is an extremal dictionary for /i imphes that 
for any x E B2 there is G ^^(/i) such that | (x/||x||2, (7'^) | > /U. Suppose, 
(a;/||a;||2, 5''^) > /x. The other case {x/\\x\\2, —g'') > /i is treated exactly the 
same way. Then 

Ik - l^g'^Wl = + At^ - 2iJ,{x,g^) < \\x\\\ + /i^ - 2;u2||x||2 < 1 - /i^. 

□ 

The problem of estimating N{d,fj,) is well studied (see, for instance, 
section 5.7, p. 314). It is known (see [4], p. 315) that for a system T> 
with #D > 2n we have M{T>) > (2n)^^/'^. Thus, a natural range for /x is 
[(2n)~i/2, 1]. In particular, the following bound is known (see [4], p. 315) 

N{d, /i) < exp(Cic;^2 in(2//i)), /i G [(2n)-i/2^ 1/2]. (4.1) 
As a corollary of (14. ip and Theorem 14.11 we obtain the following statement. 
Corollary 4.1. For r = (1 -At^)^/^ /i G [{2n)-^/^,l/2], we have 

Nr{B2) < 2exp{Cidf?\n{2/fx)). 

5 Covering in Banach spaces using incoher- 
ent dictionaries 

We use here a generalization of the concept of M-coherent dictionary to the 
case of Banach spaces. This generalization was published in |3] (see also |4] , 
p. 381). 

Let D be a dictionary in a Banach space X. We define the coherence 
parameter of this dictionary in the following way 

M{V) := M{V,X) := sup snp\Fg{h)\, 

gj^h;g,hGV Fg 
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where Fg is a norming functional for g. We note that, in general, a norming 
functional Fg is not unique. This is why wc take sup^.^ over all norming 
functionals of g in the definition of M{T>). Wc do not need supp^ in the 
definition of M{T>) if for each g & T> there is a unique norming functional 
Fg e X*. Then we define V* :— {Fg, g eV] and call V* a dual dictionary to 
a dictionary V. It is known that the uniqueness of the norming functional 
Fg is equivalent to the property that 51 is a point of Gateaux smoothness: 

limdb + uy\\ + \\g - uy\\ - 2||5f||)/'u = 

for any y ^ X. In particular, if X is uniformly smooth then Ff is unique for 
any / 7^ 0. 

Let T) :— {g^}jLi be a normalized system of vectors in X, which is 
equipped with a norm \\ ■ \\, g^ = {gl, . . . , 5^^)^. Denote by 

a, d X N matrix formed by column vectors {g-^}- Suppose for simplicity that 
for each g^ there is a unique norming functional Fgj G X*. Each functional 
Fg3 G X* can be associated with a vector G M!^ in such a way that 
wf = Fgj (e*), i = 1, . . . , Then 

d d 
i=l i=l 

Consider the matrix 

W := [w\...,w^] 

which is a. d X N matrix formed by column vectors {w^}. Consider the 
transposed matrix that is formed by the row vectors {wl , . . . , ty^) , j — 
1, . . . , N, OT by the column vectors hi := {wj, . . . , wf)'^, i — 1, . . . ,d. Define 
the coherence matrix of a dictionary V as follows 

C(V) := W'^^. 

Then the coherence matrix C{T>) of the system V = {g^}^^^ satisfies the 
following inequality for the rank: rankC(X') < d. Indeed, the columns of 
C(X>) are linear combinations of d columns hi,i — 1, . . . ,d. It is clear that the 
coherence matrix C{V) = \ \cij\\^ij^i, Cij = Fgi{g^), has 1 on the diagonal 
and for all off-diagonal elements we have \cij\ < M{T>). 
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In this section we discuss the following characteristics 

N{d, fi,X):= sup{N : 3V such that > A^, M{V, X) < /i}. 

We now use a fundamental result of Alon (see, for instance, p. 317) to 
derive an upper bound for N{n, fi, X) from the property rankC(I') < d. 

Theorem 5.1. Let A := \\o,i,j\\i^j=i be a square matrix of the form ai^i = 1, 
i = 1, . . . , N ; \aij\ < e < 1/2, i ^ j . Then 

mm{N,{\nN){e^\n{2/e))-^) < CarankA (5.1) 

with an absolute constant €2- 

We apply this theorem with A = C{T>) and e = /i. For 
< (lnA^)(/i2ln(2//i))-i implies that 

N < C2d. 

For A^ > (lnA^)(/x2ln(2//i))-i implies that 

(lnAr)(/i2in(2//i))-i < Cid 

and 

N < exp(C2 V ln(2//i)). (5.2) 

Thus, 

A^ < max{C2d,exp{C2dfi^ ln(2//i))). 
We formulate the above result as a theorem. 

Theorem 5.2. For a Banach space X which is equipped with a norm || ■ || 
we have 

N{d, /i, X) < max(C2rf, exp(C2c//i2 ln(2//i))). (5.3) 

In particular, in the case fi = C-sd^^^'^, inequality (15. 3p gives the polyno- 
mial bound N{d,n,X) < rf'^*. 

Let X be a uniformly smooth Banach space with modulus of smoothness 
p{u). Denote by a(/i) a solution (actually, it is a unique solution) to the 
equation 

a/i = 4p(2a) 

if it exists and set a(/i) := 1 otherwise. Then we always have 4p(2a(/i)) < 
a(/i)/i. Denote by V{fi,X) a dictionary such that M{V{fi), X) < fi and 
\V{fi,X)\ = N{d, fi, X). We call such P(/i,X) an extremal dictionary for a 
given /i in the space X. 
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Theorem 5.3. Let V{fi, X) := {g'^yi.li'^' be an extremal dictionary for a 
given fi in the space X . Then 

Bx C (ufj^^'^)i?^(a(/i)^?^r))U(u;jf'^'^)i?^(-a(/.)^7^r)), r = l-^/.a(/.). 
Thus, Nr{B) < 2N{d,n,X) with r = 1 - i/ia(/i). 

Proof. Our assumption that V{fi,X) is an extremal dictionary for /i in the 
space X imphes that for any x G Bx there is g'^ e V{fj,,X) such that 
\Fx{g'')\ > /i. Suppose, F^^g^) > fi. The other case F^^—g^) > /i is treated 
exactly the same way. Without loss of generality we assume that ||x|| > 1/2. 
Then by Lemma [3. II we get 

\\x - a{^)g^\\ < \\x\\ - a{^)Fx{g^) + 2||x||p(2a(/i)) 
< 1 — /ia(yu) + 2p(2a(/i)) < 1 — ]-fia{fi). 

□ 

As a corollary of Theorem 15.21 and Theorem 15.31 we obtain the following 
statement. 

Corollary 5.1. For r = 1 — |/ia(/i), p < 1/2, we have 

Nr{Bx) < 2max(C2d,exp(C2rf/i2ln(2//i))). 

Remark 5.1. Let uj{u) be a continuous majorant of p{u), u G [0,oo), such 
that uj{u)/u monotone decreases to as m — )• 0. Define a{u,p) as a solution 
to the equation 

a/i = Au{2a) (5.4) 

if it exists and set a{u,fi) = 1 otherwise. 

Theorem \5.3\ and Corollary \5.1\ hold with a{fi) replaced by a{u,fj,). 

6 Some examples 

In this section we discuss the above results demonstrating their power on 
some specific examples. 
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Example 1. Assume that X, being a uniformly smooth Banach space 
with norm || ■ ||, has modulus of smoothness of power type: p{u) < '~fu'^, 
q G (1,2]. Setting Ijj{u) := •yu'^ we find 

«^'^'^)= (:^)' • 

By Remark [5. II and Corollary 15.11 we get for r = 1 — ^fia{u,fi), fi < 1/2, 

NriBx) < 2max(C2C^,exp(C2d/i2ln(2//i))). 
In other words, denoting 6 := 1 — r and q' := we obtain 

Ni^siBx) < 2 max(C2c/, exp(C2(g, i)d6^/'^' ln(2/5))). (6.1) 
In particular, if g = 2 and 6 = ^ we get a polynomial bound 

d 

In case q G (1, 2] we get a polynomial bound for Ni^s{Bx) for 5 x c?"''/^. 
Example 2. Let X := p G (1, oo). Then it is known that 

p{u) < uP/p if 1 < p < 2, (6.2) 

p{u) < ^y^«^ if 2 < p < oo. (6.3) 
We begin with the case 2 < p < oo. Specify co{u) := Then 

op 

5 := -iia{u,ii) = 

2^^ ^ 16p' 

Thus, by Remark ISTTl and Corollary 15. II we get for r = l — ^pa{u,fi), /i < 1/2, 
Ni-siB^) < 2max(C2d,exp(8C20?p51n^)). (6.4) 
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This implies that we obtain a polynomial bound for Ni_s{Bp) in case 2 < 
J9 < oo for 5 X ^. 

In the case p G (1, 2) we set uj{u) := y and get 

1 , 1 

S := -fia{uj,fi) = C{p)fiP , fi^5^. 

As above by Remark 15. II and Corollary 15. II we get for p G (1,2) 

Ni-s{B:^) < 2max{C2d,exp{C2ip)d6^ ln|)). (6.5) 



We obtain a polynomial bound for Ni^iBp) in case 1 < p < 2 for 5 x (i)^'/^. 

Example 3. Let X be a ci- dimensional subspace of Lp, 1 < p < oo. 
Similar to Example 2 we have 

p{u) < u^/p if l<p<2, (6.6) 

p(m) < ^y^^^ if 2 < p < oo. (6.7) 

Therefore, relations (16. 4p and (16. 5p hold in this case too. 

Example 4. Let X := Proposition 11.11 guarantees that for any 
r G [1/2, 1) we have an exponential bound 

Nr{Bx) < C 

for all d-dimensional spaces X independently of their smoothness. It is easy 
to see that 

N{d,0 = 2' 
and, therefore, for all r G [1/2, 1) we have 

NriBt) > 2". 

This example shows that smoothness assumptions are important for breaking 
the exponential behavior of Nr{Bx)- 

The left inequality in Proposition 11.11 implies that for any (i- dimensional 
Banach spaces X the covering numbers Ni^s{Bx) may have polynomial 
growth in d only if 6 Examples 1-3 show that our technique based on 
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extremal /x-coherent dictionaries allows us to build polynomial in d coverings 
of Bx with r = 1 — 5, 5 ^ i, for smooth X. 

Example 5. Let X := Take a dictionary V := {±e^}^=i. Set 
a := Consider the covering 

(U^tl52(ae^r)) U (U^tiS2(-ae^ r)) . 
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We prove that there exists c > such that the above union with r > 1 ^ 
covers i?2- Indeed, for any x such that ||x||2 > 1/2 there is a coordinate value 
Xk such that > -^^^ Suppose Xk > -^^^ Then 

xl — {xk — a)^ = 2a;fca — > 
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This implies that the above explicitly written union of 2d balls of radius 
r > 1 — ^ covers B2. We can use this covering for building an explicit 
covering with smaller r. The idea is to iterate m times the above covering 
with r = 1 — ^. Then the radius of the resulting covering is r = (1 — ^)™' 
and the total number of balls in the covering does not exceed (2^)™". Using 
the notation 5 := 1 — r we get for small b 

(2^)"^ <exp(Crf51n(2(i)). 

Example 6. Let X be a uniformly smooth Banach space ^ with norm 
II ■ II and a basis \E' := }^^]^. Then for any x we have a unique representation 

d 

x = '^^Xjip'^, |xj| < i^llxll, j = l,...,d. 
i=i 

Let u{u) be a continuous majorant of p{u), u G [0,oo), such that co{u)/u 
monotone decreases to as m — )■ 0. Set a := a{co, to be a solution to the 
equation (15. 4p with /i := Take a dictionary V := {±ip''}'j=i ci-nd consider 
the covering 

(^tl5x(aV'^r)) U {Wj^.Bxi-aij^^r)) . 
We prove that the above union with r > 1 — ^a/i covers Bx- We have 

d d 

\\x\\ = F^{x) = < K\\x\\ J2 

i=i j=i 
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which imphes that for some G [l,d] 

\F,i^'')\>iKdr'=:f^. (6.8) 
Suppose Fx{ip^) > {Kd)~^. Then by Lemma [3.11 we get 

||x - a%l)^\\ < \\x\\ - aF^{%lj^) + 2||x||p(2a) 

< 1 — a/i + 2p(2a) < 1 — -a/i- 

This imphes that the above exphcitly written union of 2d baUs of radius 
r > 1 — |a/i covers Bx- We can use this covering for building an exphcit 
covering with smaUer r. As in Example 5 we iterate m times the above 
covering with r = 1 — ^a/i. Then the radius of the resulting covering is 
r = (1 — |a/i)"* and the total number of balls in the covering does not exceed 
{2d)'^. 

Examples 5 and 6 demonstrate how simple constructions of coverings with 
r < 1 can be used for e-coverings. Suppose we can construct a r-covering 
with polynomial bound N^{Bx) < d^* with r = 1 — Then, assuming 
that X has smoothness of order v?, as in Example 5, iterating this covering 
m times we get a (1 — 5)-covering with 

Ni-s{Bx) < exp{Cd6lnd), 5 > -f • 

This bound compared with the optimal bound from Proposition II. II contains 
an extra Inci factor in the exponent. However, a construction of an extremal 
dictionary for some fixed /io > cq > will give 

NroiBx) < exp{C{co)d), ro = ro(co) < 1. 

Iterating this construction we obtain 

Ne{Bx) < exp(Crfln(l/e)) 

which is optimal in the sense of order of the exponent. 
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